Layered Sensor Modalities for Improved Feature Detection

Past attempts at using multiple sensor modalities in search and rescue activities have resulted in missed detection of victims and operator disorientation. This is largely due to information overload when the operator is presented with multiple displays of information requiring attention refocus. We propose a method wherein the multiple sensor inputs are layered into a single, integrated visual display. Such a display might eliminate most missed detections and alleviate operator disorientation by allowing the operator to focus on a single display with visual cues to aid in the use of sound and other sensor modalities. We have conducted initial trials with multiple sensors in the NIST Urban Rescue Test Arena to validate the concept and aid in the construction of appropriate display modes and operations.